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PREFACE 


This  Memorandum  is  part  of  a  continuing  RAND  research  effort  in 
the  general  area  of  mathematical  programming.  It  presents  a  contribu¬ 
tion  to  the  effective  solution  of  a  general  class  of  discrete  optimi¬ 
zation  problems  such  as  the  Air  Force  encounters  in  scheduling, 
sequencing,  loading,  and  other  combinatorial  and  resource  allocation 
contexts . 

The  present  study  incorporates  and  extends  findings  from  several 
of  the  author's  earlier  publications.  It  is  a  sequel  to  Integer 
Progressing  by  Implicit  Enumeration  and  Bales'  Method,  The  RAND 
Corporation,  RM-4783-PR,  February  1966.  The  basic  theoretical  results 
reported  here  were  established  some  time  ago  in  an  unpublished  paper 
[13]  and  were  given,  along  with  preliminary  computational  experience, 
in  Implicit  Enumeration  Using  an  Imbedded  Linear  Program,  The  RAND 
Corporation,  RM- 5406- PR,  September  1967.  Additional  computational 
experience  was  swarized  in  Recent  Computational  Experience  with 
Three  Classes  of  Integer  Linear  Programs .  The  RAND  Corporation,  P-3699, 
October  1967.  The  present  Memorandum  supersedes  all  of  these  reports, 
and  is  Intended  for  operations  analysts  with  a  background  in  mathematical 
progressing  and  familiarity  with  RM-4783-PR. 

The  author  is  a  consultant  to  The  RAND  Corporation. 


SUMMARY 


This  Memorandum  synthesizes  the  Balaslan  Implicit  enumeration 
approach  to  Integer  linear  programing  with  the  approach  typified  by 
Land  and  Doig  [19]  and  by  Roy,  Bertler  and  Nghiem  [23].  The  synthesis 
results  from  the  use  of  an  imbedded  linear  program  to  compute  surrogate 
constraints  that  are  as  "strong"  as  possible  In  a  sense  slightly 
different  from  that  originally  used' by  Glover  [l5].  A  very  simple 
Implicit  enumeration  algorithm  fitted  with  optional  imbedded  linear 
programing  machinery  was  Implemented  and  tested  extensively  on  an 
IBM  7044.  Use  of  the  imbedded  linear  program  dramatically  reduced 
solution  times  in  virtually  every  case,  and  sufficed  to  render  the 
tested  algorithm  superior  to  the  five  other  implicit  enumeration 
algorithms  for  which  comparable  published  experience  was  available. 

The  crucial  issue  of  the  sensitivity  of  solution  time  to  the  number 
of  Integer  variables  was  given  special  attention.  Sequences  were  run 
of  set  covering,  optimal  routing,  and  knapsack  problems  with  multiple 
constraints  of  varying  sizes  up  to  90  variables.  The  results  suggest 
an  extraordinary  working  hypothesis:  that  use  of  the  Imbedded  linear 
program  in  the  prescribed  way  reduces  solution  time  dependence  on  the 
number  of  variables  from  exponential  to  low-order  monomial  increase. 

The  dependence  appeared  to  be  approximately  linear  for  the  first  two 
problem  classes,  with  90  variable  problems  typically  being  solved 
in  about  13  seconds;  and  approximately  cubic  for  the  third  class,  with 
80  variable  problems  typically  solved  in  less  than  2  minutes.  In  the 
35-variable  range  for  all  three  classes,  use  of  the  Imbedded  linear 
program  reduced  solution  times  by  a  factor  of  about  100.  To  what 
extent  the  working  hypothesis  holds  for  various  classes  of  problems 
is  obviously  a  matter  warranting  further  study,  but  on  the  basis  of 
the  existing  evidence  it  would  appear  that  the  present  approach  permits 
the  routine  solution  of  practical  integer  programs  involving  hundreds 
of  variables. 
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I .  INTRODUCTION 

Any  bounded-variable  pure  integer  linear  programming  problem  can 
be  written  in  the  form 

(P)  Minimise  cx  subject  to  b  +  1*  i  0,  binary, 

where  c  and  x  are  n-vectors,  b  is  an  m-vector,  and  A  is  an  m  x  n  matrix. 

The  implicit  enumeration  approach  to  this  problem  has  been  the  subject 

★ 

of  considerable  recent  investigation.  This  approach  uses  a  flexible 
"backtracking"  procedure  for  methodically  searching  through  the  possible 
solutions.  Its  efficiency  depends  on  the  exclusion  of  a  sufficient 
proportion  of  the  possible  solutions  from  further  consideration  by  means 
of  various  tests  applied  to  partial  solutions.  A  partial  solution  is 
a  subset  of  the  n  variables  that  each  have  a  specific  binary  value; 
variables  excluded  from  the  subset  are  termed  free.  The  tests  usually 
amount  to  examining  the  constraints  in  an  effort  to  determine  whether 
any  completion  of  the  current  partial  solution  could  possibly  yield  a 
feasible  solution  of  (P)  that  has  a  lower  value  of  the  objective 
function  than  the  best  known  feasible  solution.  Accordingly,  the  algo¬ 
rithm  either  continues  by  augmenting  the  current  partial  solution  or 
backtracks  to  a  different  one.  Backtracking  implies  that  all  possible 
completions  of  the  current  partial  solution  have  been  accounted  for 
(implicitly  enumerated) . 

Most  of  these  tests  can  be  applied  at  a  reasonable  computational 
coat  essentially  to  only  one  constraint  at  a  time.  Glover's  suggestion 
[15]  for  mitigating  this  limitation  is  to  periodically  introduce  addi¬ 
tional  "surrogate"  constraints  that  are  redundant  in  the  usual  sense 
and  yet  effective  when  the  tests  are  applied  to  them  individually. 

These  constraints  are  composed  primarily  from  the  given  constraints  by 
nonnegative  linear  combination.  This  is  the  starting  point  of  the 
present  study. 

In  the  next  section  we  review  the  rudiments  of  implicit  enumeration 
with  surrogate  constraints.  In  Sec.  Ill  we  introduce  a  measure  of  the 
"strength"  of  a  given  surrogate  constraint  slightly  different  from  the 

* 

See,  for  example,  Refs.  I,  2,  3,  4,  9,  10,  U,  15,  21,  22,  and  26. 


one  implicitly  used  by  Glover.  It  is  shown  how  surrogate  constraints 
that  are  as  strong  as  possible  in  this  sense  can  be  computed  by  linear 
programming.  This  not  only  obviates  the  need  for  approximate  methods 
of  finding  good  surrogate  constraints,  but  also  leads  to  an  additional 
important  advantage  because  the  dual  of  the  required  linear  program 
coincides  exactly  with  the  continuous  version  of  (P)  in  the  free 
variables.  Consequently  the  resulting  class  of  algorithms  for 
solving  (P)  can  be  considered  a  synthesis  of  the  implicit  enumeration 
approach  as  typified  by  Balas  [l]  and  the  approach  typified  by  Land 
and  Doig  [l9]  and  Roy,  Bertier  and  Nghiem  [23].  We  also  mention  the 
connection  of  the  present  work  to  recent  Independent  work  by  Balas  [2] 
and  Spielberg  [24]. 

In  Sec.  IV  we  present  extensive  computational  experience  with 
problems  of  up  to  80  variables  taken  from  the  literature.  The  algorithm, 
implemented  and  tested  on  the  IBM  7044,  was  among  the  simplest  possible 
with  the  present  approach.  No  ad  hoc  "tests"  beyond  the  basic  binary 
infeasibility  test  (see  Sec.  II)  were  used,  so  that  no  advantage  was 
taken  of  special  problem  structure.  The  improvements  wrought  by  using 
an  imbedded  linear  program  in  the  prescribed  way  were  dramatic,  and 
sufficed  to  make  even  this  bare-bones  algorithm  very  efficient  relative 
to  the  other  implicit  enumeration  algorithms  for  which  comparable  pub¬ 
lished  experience  was  available  (those  of  Balas  [l],  Fleischmann  [9,13], 
Lemke  and  Spielberg  [21],  Petersen  [22],  and  Woiler  [26]). 

Section  V  presents  empirical  results  concerning  the  influence  of 
problem  size  (number  of  variables)  on  solution  time.  This  is  a  crucial 


issue  that  must  be  faced  by  any  integer  programing  approach  offered 
as  being  of  practical  Interest.  Sequences  were  run  of  set  covering, 
optimal  routing,  and  knapsack  problems  with  multiple  constraints  of 
varying  sizes  up  to  90  variables.  The  results  suggest  the  following 
working  hypothesis:  that  use  of  the  Imbedded  linear  program  reduces 


solution  time  dependence  on  the  number  of  variables  from  exponential 


to  low-order  monomial  Increase.  The  dependence  seemed  to  be  approx¬ 


imately  linear  for  the  first  two  problem  classes  and  cubic  for  the 


third.  If  this  working  hypothesis  proves  to  be  even  approximately 
correct  for  these  and  other  problem  classes,  then  the  present  approach 
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permits  practical  integer  programs  involving  hundreds  of  variables 
to  be  solved  routinely.  Ninety  variable  problems  of  the  first 
two  classes  were  typically  solved  in  abf  t  15  seconds,  and  80 
variable  problems  of  the  third  class  were  typically  solved  in  less 
than  2  minutes.  In  the  range  of  35  variables,  for  all  three  classes, 
use  of  the  imbedded  linear  program  reduced  solution  times  by  a  factor 
of  about  100. 

Section  VI  presents  the  easy  and  natural  extension  of  the  present 
approach  to  the  mixed  integer  case. 


II.  IMPLICIT  ENUMERATION  WITH  SURROGATE  CONSTRAINTS 


Denote  a  partial  solution  by  an  ordered  set  S,  where  each  element 

is  a  nonzero  Integer  between  -n  and  n  that  may  or  may  not  be  underlined. 

An  element  j  (-  j)  of  S  indicates  that  x  takes  on  the  value  1  (0)  in 

J  S 

the  partial  solution.  Using  an  obvious  notation,  we  write  x.  ■  1  (»  0) 


J 


th 


if  j  (-  j)  is  in  S.  The  significance  of  an  underline  at  the  k  posi¬ 
tion  (counting  from  the  left)  is  that  all  completions  of  the  partial 
solution  up  to  and  including  the  ktb  element  complemented  have  been 
accounted  for.  Associated  with  any  partial  solution  S  is  an  integer 
program  (Pg)  involving  the  free  variables  (the  variables  not  fixed  by 
S)  : 


<V 


Minimize 


subject  to 


bi  + 


5  +  £  *‘j’> 


2  0,  i  -  1 . . 


0  *  Xj  £  1  and  integer, j  i  S, 


where  the  notation  J  €  S  (£  S)  refers  to  the  fixed  (free)  variables. 

In  addition  to  the  original  m  constraints,  (P^)  may  also  be 
expanded  to  Include  one  or  more  surrogate  constraints,  each  of  which 
is  a  nonnegative  linear  combination  of  the  original  constraints  plus 

the  constraint  (z  -  cx)  >  0,  where  i  is  the  value  of  the  currently 

★ 

best-known  feasible  solution  of  (P) .  More  precisely,  each  surrogate 
constraint  has  the  form 


If  no  feasible  solution  is  known  a  priori  (Indeed,  (P)  may  be 
Infeasible),  S  can  be  initially  taken  as 
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Vi(b  +  Ax)  +  (l  -  cx)  >  0 


for  some  nonnegative  m-vector  y.  Such  a  constraint  is  clearly  satisfied 
by  any  feasible  solution  of  (P)  that  has  a  better  value  of  cx  than  1. 

From  the  results  of  Ref.  14  or  15  it  follows  that  the  following 
schema  terminates  in  a  finite  number  of  steps  either  with  an  optimal 
solution  of  (P),  or  with  an  indication  that  no  feasible  solution  of  (P) 
exists  with  value  less  than  the  initial  value  of  2.  The  sequence  of 
partial  solutions  generated  is  nonredundant  in  the  appropriate  sense. 


SCHEMA  FOR  SOLVING  (P)  BY  IMPLICIT  EMUMERATIOH 

Step  0:  Initialise  2  at  a  known  upper  bound  on  the  optimal 
value  of  (P) ,  and  S  at  an  arbitrary  partial  solution  without 
underlines . 


Step  1:  If  (Pg)  is  obviously  devoid  of  a  feasible  solution 
with  value  less  than  2,  go  to  Step  4.  If  (Pg)  has  an  obvious 
optimal  solution  with  value  less  than  I,  then  replace  l  by 
this  value,  store  the  optimal  solution  as  an  Incumbent,  and 
go  to  Step  4.  If  any  free  variable  must  obviously  take  on 
a  particular  binary  value  in  order  for  (Pg)  to  have  a  fea¬ 
sible  solution  with  value  less  than  2,  then  augment  S  on 
the  right  by  J  (-  J)  for  each  variable  that  must  take  on 
the  value  1  (0) . 

Step  2:  Add  a  new  surrogate  constraint  and/or  delete  one 
or  more  current  surrogate  constraints,  or  do  neither. 


Step  3:  Augment  S  on  the  right  by  ±  J  for  some  free  variable 
(or  several  free  variables)  x^ . 

Step  4:  Locate  the  rightmost  element  of  S  that  is  not 
underlined.  If  none  exists,  terminate;  otherwise,  replace 
the  element  by  its  underlined  complement  and  drop  all 
elements  to  the  right.  Return  to  Step  1. 


There  is  a  wide  variety  of  possible  mechanisms  for  implementing 
Steps  1  and  3.  Many  can  be  found  in,  or  adapted  from,  Refs.  1,  4,  9, 


I 
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10,  14,  15,  21,  22,  and  26.  The  possibilities  are  further  multiplied 
because  the  conditional  instructions  of  Step  1  can  be  executed  in  any 
order  or  even  in  parallel.  It  is  Important  to  observe  that  many  of 
the  possible  mechanisms,  and  perhaps  most  of  the  ones  that  are  rela¬ 
tively  Inexpensive  computationally,  essentially  apply  to  the  constraints 
taken  one  at  a  time.  At  Step  1,  for  example,  a  prominent  role  is  often 
played  by  tests  for  binary-lnfeasibi lity  and  for  conditional  binary- 
infeasibility,  with  each  constraint  being  considered  individually.  A 
constraint  is  said  to  be  binary- infeasible  if  it  has  no  binary  solution, 
ar.d  is  said  to  be  conditionally  binary-infeasible  if  its  binary  feasi¬ 
bility  is  conditional  upon  certain  of  the  variables  taking  on  particular 
binary  values.  It  is  easily  verified  that  g  +  E^o.x.  2  o  (>  0)  is 
binary  infeasible  if  and  only  if  &  +  Max  {0,  a]  <0  (s  0) ;  and 
B  +  Max  [0,  o^}  -  lajQ|  <  0  (s  0)  implies  x^  ■  0  or  1,  according 

as  <  0  or  a  ^  >  0,  in  any  binary  solution  of  0  2  0  (>  0) . 

This  leads  naturally  to  the  desire  to  introduce  surrogate  con¬ 
straints  at  Step  2  that  are  "strong"  in  the  sense  that  such  tests 
are  effective  when  applied  to  them. 
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III.  COMPUTING  STRONGEST  SURROGATE  CONSTRAINTS 
BY  LINEAR  PROGRAMMING 

Since  at  any  given  stage  of  the  calculations  only  a  subset  of  the 
variables  is  free,  the  "strength"  of  a  surrogate  constraint  must  be 
defined  relative  to  the  current  partial  solution  S.  The  special  role 
played  by  conditional  and  unconditional  binary-infeasibility  (see  Sec. 
II)  suggests  that  "strength"  be  defined  in  accordance  with  how  near  a 
constraint  is  to  being  binaryinfeasible . 

Definition .  The  surrogate  constraint  p^(b  +  Ax)  +  (z  -  cx)  >  0 

is  said  to  be  stronger  relative  to  S  than  the  surrogate  constraint 
2 

U  (b  +  Ax)  +  (i  -  cx)  >  0  if  the  maximum  of  the  left-hand  side  of 
the  first  constraint  is  less  than  the  maximum  of  the  left-hand 
side  of  the  second  constraint,  the  maxima  being  taken  over  binary 
values  of  the  free  variables. 

(For  purposes  of  comparison,  the  corresponding  definition  Glover 

implicitly  uses  [15]  seems  to  be:  the  surrogate  constraint  M-*(b  +  Ax) 

2  0  is  said  to  be  stronger  relative  to  S  than  the  surrogate  con- 
2 

straint  y.  (b  +  Ax)  i  0  if  the  maximum  of  (z  -  cx)  subject  to  the 
first  constraint  is  less  than  the  maximum  of  (z  -  cx)  subject  to  the 
second  constraint,  the  maxima  being  taken  over  binary  values  of  the 
free  variables .) 

Finding  a  strongest  surrogate  constraint  is,  then,  the  problem 
of  minimizing,  over  all  y,  *  0,  the  expression 

(1>  Haxln(b  +  Ax)  +  (z  -  cxljx^  -  0  or  1,  j  «  S  and 

“  *j.j  €  S} 


t 


or,  upon  rearrangement,  the  expression 


bs 

hi  i 


?  +  t  -  zS  +  Max 


j8®v«  •  •  °  °r  *• 1  *  sl 


where  we  have  introduced  the  notation 


■  gv!  *"d  b*  ■  bi +  gv 


Now  for  any  p.  £  0  we  have 


m 

1$  S'*^  ■  ^  ■ 0  ° 


r  1,  J  i  S 


m 

g  QstVi> '  0  4  "j 


s  i.  j  «  s 


-  Min 


IU 

g"j|“j  e  0  *"'1  "j s  gvu  - 


Oj.j  «  S  , 


where  the  second  equality  follows  from  the  Dual  Theorem  of  linear 
programming.  Using  (3)  in  (2),  we  obtain  the  following  linear  program: 


Minimize 


ZXbi  +  *  -  *s  +  £ 

L,W  i-1  1  1  J  i  s  J 


subject  to  w 


j  -  gvu  5 


Wj  *  o,  )  4  s  and  ti  J  0. 
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Denote  the  infimal  value  of  (LPg)  by  V(LP$) .  It  is  easy  to  see  that 
the  desired  result  is  now  at  hand. 

Proposition:  Let  S  be  an  arbitrary  partial  solution.  Then  (LPg) 

is  necessarily  feasible,  and 

A.  v(LP  )  ^  o  *»  there  exists  a  binary-infeasible  surrogate 
constraint ; 

B.  v(LPg)  >  0  =»  there  does  not  exist  a  binary-infeasible 
surrogate  constraint,  but  any  optimal  p.  in  (LPg)  yields 
a  strongest  surrogate  constraint  relative  to  S. 


The  usefulness  of  (LPg)  is  further  enhanced  by  the  fact  that  it 
is  precisely  the  dual  of  the  continuous  version  of  (Pg)  (in  which 
0  s  Xj  ^  1  replaces  x^  ■  0  or  1).  Consequently,  with  the  help  of  the 
Dual  Theorem  of  linear  programming,  one  can  verify  that  z  -  v(LPg)  is  a 
lower  bound  on  the  optimal  value  of  (Pg) ,  and  the  optimal  dual  variables 
of  (LPg)  are  optimal  in  (Pg)  if  they  are  all  integers. 

These  results  show  not  only  how  strongest  surrogate  constraints 
can  be  calculated  by  linear  programming,  but  also  that  the  aim  of  Step 
1  can  be  accomplished  at  no  extra  computational  cost  in  the  course 
of  attempting  to  construct  a  strongest  surrogate  constraint  at  Step  2. 
More  specifically,  one  would  set  out  to  construct  a  strongest  surrogate 


constraint  by  executing  simplex  iterations  on  (LPg)  until  one  of  the 
following  mutually  exclusive  events  occurs: 


(a)  the  value  of  the  objective  function  of  (LPg)  becomes  £  0; 

(b)  an  optical  solution  of  (LP_)  is  obtained,  and  v(LP  )  >  0 

a  S 

and  the  optimal  dual  variables  are  all  integers; 

(c)  an  optimal  solution  of  (LP_)  is  obtained,  and  v(LP  )  >  0 
but  not  all  of  the  dual  variables  are  integers. 


In  event  (a),  a  binary  infeasible  surrogate  constraint  must  exist,  and 
consequently  one  may  go  to  Step  4;  in  event  (b) ,  the  optimal  solution 
of  (Pg)  is  i iven  by  the  optimal  dual  variables  of  (LPg),  so  one  should 
replace  *  by  the  new  value  and  the  incumbent  by  the  new  solution  and 
go  to  Step  4;  in  event  (c),  a  strongest  surrogate  constraint  is  obtained 
from  the  optimal  u  In  (LPg). 


» 
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Restarting  techniques  primal  with  respect  to  (LPC)  can  con- 

0 

veniently  be  used  to  take  advantage  of  the  results  of  previous  calcu¬ 
lations  each  time  Step  2  is  executed.  Since  we  do  not  always  optimise 
(LPg) ,  some  of  these  techniques  are  pre-  as  well  as  post-optimality. 

The  Revised  Simplex  format  is  convenient  in  this  regard.  Keep  in  mind 
that  the  columns  of  the  w^  are  just  the  negatives  of  the  unit  vectors 
associated  with  the  corresponding  slack  variables.  One  consequence 
is  that  the  w^  variables  can  be  treated  logically  rather  than  alge¬ 
braically,  so  that  (LPg)  is  reduced  to  essentially  m  nontrivial 
variables  and  as  many  constraints  as  free  variables.  The  other  impor¬ 
tant  consequence  is  that  it  is  easy  to  write  down  a  basic  feasible 
solution  to  (LPg)  for  any  S;  in  fact,  there  is  an  obvious  and  simple 

procedure  for  modifying  any  basic  feasible  solution  for  (LP  )  until 

s 

it  becomes  basic  feasible  for  (LP  ,),  where  S'  J4  S .  This  avoids  the 

0 

need  for  restartin'  techniques  that  are  dual  with  respect  to  (LP  ) . 

0 

It  should  be  noted  that  the  developments  of  this  section,  although 
unique  in  terms  of  motivation  and  details  of  use,  are  nevertheless 
related  in  certain  respects  to  Independent  work  by  other  authors. 

Land  and  Dolg  [l9],  Dakin  [7],  Roy,  Bertier  and  Nghlem  [23],  Herve 
[ 18 ]  and  others  have  also  described  algorithms  that  use  the  continuous 

approximation  to  discrete  programs  like  (P  ) ;  but  they  make  little 

0 

or  no  use  of  the  dual  variables  (p  and  w).  The  dusl  variables  p  are, 

however,  used  by  Balsa  In  his  "filter  algorithm"  [2]  to  determine 

his  "filter  constraint"  --  a  close  relative  of  the  type  of  surrogate 

constraint  employed  here.  He  solves  the  continuous  approximation  to 

(P  )  only  once,  with  S  empty,  rather  than  periodically.  Recently, 

0 

Glover  [l6]  has  Illuminated  the  relationship  between  Bales'  filter 
constraint  and  the  strongest  surrogate  constraint  of  this  study 
(as  presented  In  an  earlier  draft),  and  has  suggested  possible  extensions. 
Spielberg  [24]  has  also  Independently  used  an  approach  akin  to  the 
present  one,  In  the  special  context  of  the  simple  plant  location  problem. 
He  has  suggested  In  a  private  coMunlcatlon  to  the  author  that  his 
"gain  function"  is  analogous  to  our  surrogate  constraint. 
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IV.  COMPARATIVE  COMPUTATIONAL  EXPERIENCE 


IMPLEMENTATION 

A  simple  version  of  the  implicit  enumeration  procedure  has  been 
implemented  and  extensively  tested  on  an  IBM  7044.  It  is  of  completely 
general  applicability,  and  takes  no  advantage  of  special  problem  struc¬ 
tures.  Step  1  uses  just  the  simple  tests  for  conditional  and  uncondi¬ 
tional  binary- infeasibility  mentioned  at  the  end  of  Sec.  II;  it  recog¬ 
nizes  an  obvious  optimal  solution  of  (Pc),  in  the  fashion  of  Balas  til, 
only  by  the  trivial  minimization  of  cx  over  binary  values  of  the  free 
variables  while  ignoring  the  constraints,  and  then  testing  the  resulting 
solution  for  feasibility.  Step  2  follows  the  outline  and  suggestions 
given  at  the  end  of  Sec.  Ill,  except  that  a  binary-infeasible  surrogate 
constraint  is  added  anyway  in  event  (a) ,  and  in  event  (c)  the  non¬ 
integer  dual  variables  are  rounded  in  a  simple  attempt  to  discover  a 
good  feasible  solution  of  (Pg).  Step  3  uses  a  simplified  version  of 
Balas'  augmentation  rule:  augment  S  by  jQ,  where  maximizes  over 
all  free  variables  the  expression 


JjMin  {0,  b^  f  a^j. 


(This  assumes,  without  loss  of  generality,  that  c  ^  0.) 

The  program  was  written  entirely  in  Fortran  IV  for  RAND's  32,000 
word  machine.  The  object  program  and  its  data  are  all-in-core,  with 
all  problem  data  treated  as  floating  point,  and  is  dimensioned  to 
handle  problems  with  up  to  90  variables  and  50  constraints  (including 
surrogate  constraints,  if  any).*  The  linear  programming  subroutine 


W 

More  than  32,000  words  of  primary  storage  are  required  if  larger 
!!(3«TlS)  +YooO*d;  ^  nUmber  °£  W°rd8  requlred  18  approximately 


( 


Is  basically  a  Revised  Simplex  Method  with  explicit  Inverse,  the 
starting  point  having  been  a  routine  due  to  Clasen  [6],  Restarting 
techniques  were  Incorporated  that  use  a  labeling  procedure  rather 
than  more  conventional  Matrix  manipulations.  The  labeling  procedure 
la  based  on  the  observation  that  fixing  a  variable  at  the  value  0  or 
1  can  be  viewed  as  demanding  equality  in  the  appropriate  Inequality 
constraint  aMong  0  £  x  £  1,  J  €  S,  In  the  continuous  version  of  (P,,)  . 
This  Means  that  the  corresponding  dual  variables  (the  w^  and  slacks  In 
(LPg))  become  unconstrained  in  sign;  the  appropriate  variables  are 
therefore  labeled  and  treated  as  "unsigned."  This  procedure  Is  easier 
to  program  than  a  more  conventional  one  using  mstrlx  manipulations, 
and  has  the  advantage  of  being  economical  In  terms  of  core  and  setup 
time  for  the  successive  linear  programs.  It  hss  the  drawbsck,  however, 
that  (LPg)  (and  therefore  the  explicit  Inverse)  always  has  n  rows. 
Instead  of  only  as  many  rows  as  free  variables.  Hence  each  pivot 
requires  more  work. 

ms  was 

The  code  has  been  used  to  solve  numerous  test  problem  with  up 
to  80  variables  taken  from  the  literature.  The  number  of  iterations 
(executions  of  Step  1)  and  execution  times  (until  termination,  to  the 
nearest  hundredth  of  a  minute)  for  most  of  these  problems  Is  presented 
In  Tsble  1.  We  have  omitted  the  problems  too  small  to  be  of  Interest. 
Each  problem  was  run  twice:  once  skipping  Step  2,  so  thst  no  surrogste 
constraints  were  ever  computed;  and  once  with  Step  2  fully  Implemented, 
so  that  an  attempt  was  made  to  compute  a  new  surrogste  constraint  each 
time,  with  only  the  last  four  surrogate  constraints  being  kept  and  used. 
The  coluais  corresponding  to  these  runs  sre  labeled  "No  LP"  and  "LF 
Every  Tims." 

Mo  prior  Information  was  used,  such  as  an  obvious  initial  feasible 
solution  or  upper  bound  on  the  optimal  value  of  the  objective  function. 
Such  Information  was  usually  available  by  Inspection,  but  ve  did  not 
wish  to  further  confound  comparability  with  other  investigators' 

*Rafs .  1,  4,  11,  17,  21,  22,  and  25. 
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computational  result*,  which  are  reproduced  in  Table  1  for  easy 
reference.  These  other  investigators  are:  Bouvier  and  Hessoumlan 
[4],  whose  problems  are  randomly  generated  without  any  special  struc¬ 
ture  at  all;  Flelschmann  [9],  whose  "economic"  problems  are  highly 
structured;  Lemke  and  Spielberg  [21],  whose  problems  B  and  D2  are 
attributed  to  M.  Sidrow  of  Texaco,  and  problem  C  to  W.  Arcuri  of  IBM; 
Petersen  [22],  whose  problems  are  of  the  Lorle-Savage  capital  budgeting 
variety;  and  Woiler  [26]  who  ran,  among  other  problems,  a  number  of 
Haldi 'a  fixed  charge  problems  [17]  and  some  of  the  "IBM  test  problems" 
also  published  by  Haldi.  Each  of  these  Investigators  used  a  different 
adaptation  of  the  implicit  enumeration  approach. 

The  results  summarized  in  Table  1  Indicate  that  use  of  the  Imbedded 
linear  program  (LPg)  dramatically  reduces  the  number  of  required  iter¬ 
ations,  often  by  several  orders  of  magnitude;  and  that  this  reduction 
Is  more  than  enough  to  pay  for  the  time  spent  working  on  (LP  ) ,  since 
total  execution  times  were  greatly  reduced  in  almost  every  case. 

The  present  algorithm  is  evidently  very  efficient  relative  to  the 
others;  but  differences  in  programming  and  machine  speed  make  it  inad¬ 
visable  to  hazard  a  quantitative  estimate  of  the  apparent  improvement. 

For  comparison  with  various  cutting-plane  algorithms  for  the  Haldi 
and  IBM  problems,  sen  [25];  such  a  comparison,  although  by  no  means 
unfavorable  to  the  present  algorithm,  is  somewhat  prejudiced  because  upper 
bounds  on  variables  have  been  handled  here  by  binary  representation 
rather  than  directly. 

A  rather  conspicuous  feature  of  the  algorithm  with  the  imbedded  linear 
program  is  that  it  not  only  tends  to  find  near-optimal  solutions  quickly, 
but  also  tends  to  verify  an  optimal  solution  relatively  promptly  after 
one  is  found.  Exceptions  are  IBM  5  and  9  (in  each  case  an  optimum  was 
found  in  0.01  min.)  and  most  of  the  Bouvier  and  Messovasian  problems  (where 
about  90  percent  of  the  computing  time  was  spent  verifying  an  optimum) . 

QFF09TUH1T1XS  FOR  IMFUOVEMEHT 

The  results  presented  in  Table  l  are  subject  to  further  improve¬ 
ment.  Substantial  improvement  could  often  have  been  gained  simply  by 
exercising  the  basic  options  of  the  experimental  program  in  a 


-14- 


Table  1 

COMPARATIVE  COMPUTATIONAL  EXPERIENCE 


Problem 

Designation 

Prob leu 
Sire. 

0-1  Var  x 
Constraints 

No 

LP* 

LP  Every  Time* 

Other  A 1  j 

orlthms 

Iter¬ 

ations 

(7044) 

Hin 

Iter¬ 

ations 

(7044) 

Min 

Hln 

Machine 

Version 

Ref 

Bouvier  and 

m 

Messotraian  .4] 

:  ■ 

15 

20 

X 

20 

515 

21 

0.47 

7044 

4 

16 

20 

X 

20 

1,897 

1.69 

89 

Bo 

2.07 

7044 

4 

17 

20 

X 

23 

889 

1.06 

115 

0.85 

7044 

4 

18 

20 

X 

23 

569 

0.59 

1 

0.04 

0.97 

7044 

4 

22 

25 

X 

20 

4,267 

4.88 

143 

0.92 

3.27 

7044 

4 

23 

27 

X 

20 

6,565 

8.08 

171 

1.18 

7.10 

7044 

4 

24 

28 

X 

20 

>  8,117 

>10.00 

281 

1.93 

15.20 

7044 

4 

Flcischeann  [11] 

1-35 

35 

X 

8 

1,009 

0.50 

4 

°-o2k 

0.04 

7094 

Ref.  10 

9,  10 

1-50 

50 

X 

11 

>10.00 

9 

0.06b 

0.24cd 

7094 

Ref.  10 

9,10 

1-60 

60 

X 

u 

>10,367 

>10.00 

3 

0.04 

1.6Bd 

7094 

Ref.  10 

9,10 

1-80-1 

80 

X 

11 

>  8,557 

>10.00 

1 

0.03 

B.95d 

7094 

Ref.  10 

9,10 

1-80-2 

80 

X 

11 

>  8,337 

>10.00 

19 

0.20 

8.28” 

7094 

Ref.  10 

9,10 

Leake  and 

Spielberg  [21] 

B 

35 

28 

1,995 

2.39 

35 

0.19 

5.5 

360/40 

DZIP1 

21 

C 

44 

X 

12 

2,061 

1.90 

447 

1.38 

5 

360/40 

DZIP1 

21 

D2 

74 

X 

37 

>  3,838 

>10.00 

>517 

>10.00 

>30 

7094 

DZIP1 

21 

Petersen  '22j 

4 

20 

X 

10 

893 

0.46 

27 

0.04 

0.06* 

7094 

RL&R2 

22 

s 

28 

X 

10 

13,387 

8.85 

181 

0.24 

0.16* 

7094 

R1&R2 

22 

6 

39 

X 

5 

>18,857 

>10.00 

143 

0.43 

1 .18* 

7094 

R14R2 

22 

7 

50 

X 

5 

>15,577 

>10.00 

115 

0.46 

9.55* 

7094 

R16>R2 

22 

Hxldl  [17] 

II-?* 

20 

X 

4 

459 

0.10 

63 

0.03 

0.02 

360/40 

DZIP1 

21 

" 

" 

*' 

" 

*' 

0.36 

B5500 

lar-max 

26 

II-o 

20 

X 

4 

511 

0.10 

79 

0.05 

0.40 

B5500 

LAR-MAX 

26 

30 

10 

769 

0.41 

75 

0.06 

IE*  [17], 

1 

21 

X 

7 

435 

0.16 

17 

0.01 

0.13 

lar-max 

26 

2* 

21 

X 

7 

369 

0.11 

27 

0.02 

0.17 

lar-max 

26 

3* 

20 

X 

3 

217 

0.04 

17 

0.01 

0.04 

■WTO! 

LAR-MAX 

26 

4* 

30 

X 

15 

>13,995 

>10.00 

57 

0.13 

6.67 

7094 

DZIP1 

21 

5* 

30 

X 

15 

>13,858 

>10.00 

365 

1.90 

50.00 

7094 

DZIP1 

21 

6 

31 

X 

31 

>  7,038 

>10.00 

209 

2.00 

>50.00 

7094 

DZIP1 

21 

9h 

15 

X 

35 

551 

0.45 

107 

0.44 

--- 

—  * 

Except  for  tho  Hxldl  and  IBM  problaaa,  the  Initial  partial  aolutlon  war  taken  to  be  the 
aepty  one.  In  the  Haldl  problaaa,  the  Initial  partial  aolutlon  conalated  of  all  varlablaa  at 
the  value  0.  In  the  IM  problaaa,  each  of  the  original  varlablaa  war  aat  at  the  value  1. 

b 

Average  for  five  slightly  different  problems  ol  tho  um  slso. 

c Avar ago  lor  ton  slightly  dllloront  problems  ol  tho  sons  slso. 

*Thoso  times  [11]  oro  much  bottor  than  tho  tlass  announced  In  [9]  bocauao  ol  subsequent 
modifications  [L0]. 

*Thoso  tlaos  [20]  ore  auch  better  than  those  announced  In  [22]  because  Petersen's  prograa  was 
converted  to  a  looter  aachlne.  The  *1  &  12  aodlllcatlona  ere  the  best  ol  several  that  Petersen 
developed  a 

*Thle  p rob lea  vos  converted  to  0*1  Ions  using  o  six-place  binary  expansion  lor  each  original 
activity  variable.  This  aeons  to  be  the  seas  conversion  as  was  used  In  t21]  and/or  [26]. 

^Problaaa  1  through  5  aero  converted  to  0*1  lore  by  binary  representation  ol  the  variables 
using  an  upper  bound  ol  7,  7,  31,  3.  and  3  In  each  problem,  respectively.  This  seeas  to  be 
the  sasa  conversion  as  was  used  In  [21]  or  [26]. 

NlUe  problea  hod  30  constraints  originally,  bu„  the  last  15  have  been  ellalnsted  here  since 
they  only  speclly  that  the  variables  be  binary. 
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discriminating  rather  than  uniform  manner.  It  is  often  more  economical, 
for  example,  to  employ  the  imbedded  linear  program  less  frequently 
than  at  every  opportunity.  Lemke  and  Spielberg's  problem  C  was  solved 
in  0.45  instead  of  1.38  minutes  when  (LP,,)  was  used  only  every  sixteenth 
time.  Another  possibility  is  to  take  advantage  of  an  obvious  upper 
bound  on  the  optimal  value  of  a  given  problem.  When  z  was  initially 
set  at  an  upper  bound  for  IBM  6  that  was  in  error  by  20  percent,  the 
solution  time  was  1.25  instead  of  2.00  minutes.  A  third  possibility 
for  improvement  involves  making  a  more  appropriate  choice  of  the  initial 
partial  solution.  More  plausible  initial  partial  solutions  than  the 
empty  one  are  often  obvious  when  the  problem  data  are  inspected.  This 
was  so  for  IBM  6,  and  its  use  reduced  the  solution  time  from  2  minutes 
to  less  than  4  seconds.  Another  source  of  good  initial  solutions  for 
some  problems  is  the  linear  programing  solution  of  the  continuous 
approximation  to  (P) .  If  we  take  the  Initial  partial  solution  to  be 
empty,  the  dual  variables  of  (LPg)  the  first  time  around  yield  this 
solution.  Taking  the  next  partial  solution  to  consist  of  the  naturally 
Integral  variables  causes  the  algorithm  in  effect  to  examine  all  possible 
roundings  of  the  continuous  solution  first.  An  option  to  begin  in 
this  way  --  we  call  this  the  "LP  start"  --  has  proven  effective  for 
many  problems  (e.g.,  Lemke  and  Spielberg  C  is  solved  in  0.44  minute, 
and  IBM  6  in  0.34  minute). 

Finally,  we  mention  that  a  very  important  source  of  improvement 
would  be  to  use  tests  at  Step  1  that  are  more  powerful  than  the  simple 
binary-infeasibility  test.  The  dramatic  improvements  Fleischmann  [9] 
and  Petersen  [22]  achieved  over  the  original  Balasian  algorithm  testify 
to  the  untapped  potential  here.  Some  of  the  more  powerful  tests  are 
of  general  applicability,  while  others  capitalize  on  special  problem 
structures  (remember  that  we  have  not  taken  any  advantage  here  whatever 
of  special  structure  In  the  test  problems).  Obviously  one  can  take 
advantage  of  structure  not  only  by  introducing  specialized  tests  at 
Step  1,  but  also  by  exploiting  it  in  the  LP  subroutine  that  is  used  to 
solve  (LP,.)  ,  since  (LP,,)  inherits  the  structure  of  (P) .  It  remains 
also  to  implement  various  augmentation  rules  for  Step  3  other  than 
Balas'.  For  example,  combining  Balas'  augmentation  rule  with  a 
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restriction  to  the  free  variables  corresponding  to  fractional  dual 
variables  of  (LPg)  seems  to  generally  improve  performance  —  for  Leake 
and  Spielberg  C,  it  reduced  the  solution  time  to  0.60  minute. 
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V.  INFLUENCE  OF  PROBLEM  SIZE 

The  ultimate  practical  usefulness  of  any  Integer  programming 

algorithm  depends  on  the  crucial  question,  "How  fast  does  solution  time 

increase  with  problem  size?"  The  number  of  variables  Is  perhaps  the 

main  determining  factor  for  implicit  enumeration  algorithms,  since 

the  number  of  possible  solutions  of  (P)  is  2n.  If  solution  times  tend 

★ 

to  increase  exponentially  with  the  number  of  variables,  as  has  been 
suggested  of  Balas  algorithm,  then  there  is  little  hope  of  ever 
being  able  to  solve  really  large  problems  directly. 

Probably  this  important  question  can  be  answered  only  within  the 
context  of  specific  problem  classes,  and  even  then  only  with  a  speci¬ 
fically  parameterized  population  of  problems  of  differing  sizes.  We 
shall  summarize  our  experimental  investigations  in  the  range  of  30-90 
variables  for  three  important  classes  of  problems •  set  covering, 
optimal  routing,  and  knapsack  with  several  constraints.  The  main  con¬ 
clusion  which  emerges  is  that,  for  the  problems  run,  the  imbedded  linear 
program  mitigates  approximately  exponential  dependence  of  computing 
time  on  the  number  of  variables  to  what  appears  to  be  low-order  mo¬ 
nomial  dependence  --  approximately  linear  in  the  first  two  cases,  and 
cubic  in  the  third.  If  these  results  are  at  all  indicative,  then  the 
present  algorithm  can  be  expected  to  cope  routinely  with  quite  large 
structured  Integer  linear  programs. 


SET  COVERING 

<-  ,  .  _  ***  **** 

bet  covering  problems  were  randomly  generated  to  have  30 

constraints,  a  density  of  0.07,  and  no  column  dominance.  Five  samples 

each  were  generated  with  30,  40,  ....  90  variables.  Each  problem  was 


li,  if  the  solution  time  is  proportional  to  some  constant 
greater  than  unity  raised  to  the  nth  power. 

**  r  -i  r  _ 

See  Castellan  L 5 J ,  Fulkerson  [12J,  and  the  results  below. 

***  r  i 

Balinski  L 3 J  has  given  an  excellent  discussion  of  the  structure 
and  applications  of  set  covering  problems. 

**** 

Professor  Melvin  Breuer,  USC,  generated  the  problems 
incidentally  to  certain  other  investigations. 
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run  with  an  empty  initial  partial  solution,  (LPg)  used  at  every  oppor¬ 
tunity,  and  with  the  last  four  surrogate  constraints  retained.  The 
computational  results,  presented  In  Table  2,  suggest  that  the  solution 
times  are  increasing  approximately  linearly  with  the  number  of  variables. 

Table  2 


SET  COVERING  PROBLEMS  (30  CONSTRAINTS) 


No.  0-1 
Variables 

Avg  Solution  Time 
For  5  Problems  (Min) 

Avg  No. 
Iter 

30 

0.03 

3 

40 

0.07 

6 

50 

0.08 

4 

60 

0.14 

6 

70 

0.15 

8 

80 

0.21 

6 

90 

0.17 

4 

An  attempt  was  also  made  to  run  some  of  the  problems  without  the 
Imbedded  linear  program.  The  two  attempted  30-varlable  problems  were 
solved  in  1.6  and  1.2  minutes,  but  the  three  attempted  40-varlable 
problems  each  exceeded  their  time  limit  of  16  minutes.  A  sequence  of 
smaller  sec  covering  problems  with  IS  constraints  and  density  0.2  was 
then  run.  The  results  are  summarised  in  Table  3.  When  plotted  on 
semi log  paper,  it  seems  that  times  are  increasing  exponentially  with 
the  number  of  variables. 


Table  3 

SET  COVERING  PROBLEMS  (15  CONSTRAINTS): 
IMBEDDED  LINEAR  PROGRAM  NOT  USED 


No.  0-1 
Variables 

Avg  Solution  Time 
For  4  Problems  (Min) 

Avg  No. 
Iter 

15 

0.02 

44 

20 

0.07 

137 

25 

0.42 

689 

30 

1.13 

1657 

35 

3.59 

4744 
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Finally,  a  representative  selection  of  the  above  problems  was 
converted  to  have  a  modified  form  of  objective  function  which  is 
supposed  [3,  p.  306]  to  be  relatively  difficult  for  cutting-plane 
algorithms:  each  cost  coefficient  was  set  at  the  number  of  ones  in 
its  column.  Experiments  indicate  that  this  kind  of  weighted  set  cov¬ 
ering  problem  is  only  slightly  more  difficult  when  the  imbedded  linear 
program  is  used . 


OPTIMAL  ROUTING  IN  NETWORKS 

Consider  a  network  with  nodes  connected  by  L  links,  with  link  i 

having  capacity  c.,  and  having  K  distinguished  source-sink  pairs. 

Associated  with  each  source-sink  pair  is  a  required  flow  d^,  and  a 

collection  of  routes  along  which  flow  is  permitted.  Let  the  set 

index  the  routes  permitted  for  source-sink  pair  k,  and  y.  bt  the  flow 

at  unit  price  p.  through  route  j  for  j  e  J  .  Designate  the  link-route 
J  k 

matrix  by  A;  that  is,  a_  is  1  if  link  i  is  on  route  j,  and  is  0  other¬ 
wise.  The  problem  is  to  meet  the  demands  at  minimum  cost  by  integral 
flow  over  permissible  routes,  without  exceeding  the  link  capacities: 


Minimize 


K 


Z 

k-1 


subject 


to 


K 

£  a  y  *  c  ,  i-1, 
k-1  jeJk  J  1 


*  *  *1 


L 


22  *  dw.  . K 

>eJk  J 

yJ  2  yJ  lnte**r- 


The  particular  numerical  example  used  was  adapted  from  the  model 
and  data  of  [8].  In  the  language  of  this  reference,  there  are  9  air 


t 
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bases  (nodes)  and  9  origin-destination  pairs  (K  ■  9)  requiring  various 
tonnages  (d^)  of  air  cargo  shipments.  A  total  of  45  permissible  routes 
are  allowed  for  the  shipments,  each  of  which  involves  a  subset  of  32 
given  segments  (links).  Each  segment  is  taken  to  contribute  a  cost 
per  unit  shipped  proportional  to  its  air  mileage,  and  to  have  a  capacity 
of  3  units  of  air  cargo.  Hence  each  y  is  bounded  above  by  3,  and 
therefore  admits  binary  representation  by  two  binary  variables;  a  total 
of  90  binary  variables  is  required. 

The  problem  was  solved  in  full  90  variable  form  and  also  with 
some  of  the  routes  eliminated.  In  each  case  the  initial  partial 
solution  was  empty,  (LP«.)  was  used  at  every  opportunity,  and  the  last 
four  surrogate  constraints  were  retained.  The  solution  times  are  given 
in  Table  4.  As  with  the  set  covering  problems,  solution  times  seem  to 
increase  not  much  faster  than  linearly  with  the  number  of  variables. 


Table  4 

OPTIMAL  ROUTING  PROBLEMS  (41  CONSTRAINTS)* 


a 

Due  to  the  method  of  problem  generation, 
some  of  the  constraints  turn  out  to  be  trivial 
in  the  problems  with  less  than  90  variables. 

When  the  algorithm  ran  without  the  Imbedded  linear  program  on 
the  two  smaller  problems,  it  tended  to  find  an  optimal  solution  Just 
about  as  quickly,  but  took  much  longer  to  verify  optimality- -8.0 
minutes  for  the  36-variable  problem,  and  In  excess  of  the  16-minute 
time  limit  for  the  48-varlable  problem. 
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KNAPSACK  WITH  MULTIPLE  CONSTRAINTS 

A  "knapsack"  problem  with  5  constraints  and  82  variables  was 
constructed  from  the  largest  problem  in  [22],  The  latter  problem,  of 
the  Lorie-Savage  capital  budgeting  variety  with  50  alternative  projects 
subject  to  5  capital  constraints,  was  augmented  by  32  similar  projects. 
Smaller  problems  were  then  constructed  by  randomly  selecting  subsets 
of  the  82  projects.  The  right-hand  side  was  kept  in  constant  propor¬ 
tion  to  the  row  sums  of  the  resulting  coefficient  matrix  in  an  attempt 
to  preserve  the  relative  degree  of  problem  difficulty.  Problems  were 

generated  in  this  way  with  30  ,  40  .  80  variables,  with  four  samples 

at  each  size.  Each  problem  was  run  using  an  "LP  start"  (see  Sec.  IV), 
with  (LPg)  used  at  every  opportunity,  and  with  the  last  six  surrogate 
constraints  retained.  The  results  are  given  in  Table  5. 


Table  5 

KNAPSACK  (5  CONSTRAINTS) 


No.  0-1 
Variables 

Avg  Solution  Time 

For  4  Problems  (Min) 

Avg  No. 
Iterations 

30 

0.09 

79 

40 

0.27 

139 

50 

0.44 

164 

60 

0.55 

189 

70 

1.11 

293 

80 

1.85 

361 

Without  the  Imbedded  linear  program,  the  results  given  in  Tabie 
6  were  obtained. 


Table  6 

KNAPSACK  (5  CONSTRAINTS): 
IMBEDDED  LINEAR  PROGRAM  NOT  USED 


No.  0-1 
Variables 

Avg  Solution  Time 

For  4  Problems  (Min) 

Avg  No. 
Iterations 

15 

0.02 

178 

20 

0.06 

402 

25 

0.36 

1,857 

30 

1.59 

7,064 

35 

9.74 

38,385 
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With  the  imbedded  linear  program,  solution  times  seem  to  increase 
approximately  as  the  third  power  of  the  number  of  variables.  Without 
the  imbedded  linear  program,  however,  a  semilog  plot  suggests  that 
times  are  going  up  exponentially  with  the  number  of  variables. 
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VI.  EXTENSION  TO  THE  MIXED  INTEGER  CASE 

Extension  to  the  mixed  integer  problem  is  natural  and  completely 
straightforward.  Suppose  that  (P)  is  of  the  form 


(4) 


Minimise  cx  +  dy 

Subject  to  Ax  +  Dy  +  b  1  0 

0  £  Xj  *  1  and  integer,  j  *  1 . n 

y  £  0, 


where  d  and  y  are  n^-vectors  and  D  is  an  m  x  n^  matrix.  A  partial 

solution  is  still  defined  in  terms  of  a  subset  of  the  x.,  but  a  "cora- 

J 

pletlon"  now  Involves  a  choice  of  y  as  well  as  a  choice  of  the  free 

x  variables.  The  analog  of  (P  )  is  the  mixed  program: 

1  *> 


(5) 


Minimize  z  +  7^  c.x  +  dy 

J|S  J  J 


A 

subject  to  b^  +  £  a  x  +  7  .  d.  . 

j?S  J  J  j-1 


yj  2  l  "  l>  •••>m 


0  4  Xj  s  l  and  integer,  j  S 

V°'J*1-  ••••  v 


and  the  procedure  of  Sec.  II  remains  valid  with  surrogate  constraints 
of  the  form 


b(b  +  Ax  +  Dy)  +  (i  -  cx  -  dy)  >  0. 

The  concept  of  blnary-lnfeasibllity  is  modified  to  account  for  the 
presence  of  y  in  the  obvious  way,  and  so  is  the  definition  of  "strength." 
The  analog  of  (LPg)  is 
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m 

Minimize  g.bf  +  z  -  z^  +  ✓_]  w. 

U  ,w  t=I  1  1  Ws  * 

<6) 

Subject  to  w  *  5j  P.  a  -  c  ,  j  g  S 
j  t.i  1  J 

H0£d. 

V  £  0 

y  o,  j  i  s. 

One  uses  (6)  in  a  manner  precisely  analogous  to  the  use  of  (LP^) • 

The  only  possible  complication  Is  that  (6)  may  be  lnfeaalble,  i.e., 

Ip  2  0  :  p  D  £  d;  may  be  empty.  To  avoid  this  possibility,  we  can  assume 

that  the  minimand  of  the  continuous  version  of  (4)  (i.e.,  without  the 

integrality  requirement)  is  bounded  from  below.  This  assumption  can 

be  enforced.  If  necessary,  by  adding  an  additional  constraint  sucn  as 
n, 

E^  y^  <  M  or  ex  +  dy  2  -M,  where  M  is  a  suitably  large  positive 

number.  Then  it  is  easy  to  show  that  (6)  is  infeasible  only  if  (4) 

is  also  infeasible,  in  which  case  the  entire  procedure  terminates. 

This  extension  has  not  been  tested  computationally. 

Another  extension  that  has  not  been  tested  computationally  is  the 

handling  of  general  upper  bounds  on  the  integer  variables  directly  rather 

than  by  conversion  to  the  0-1  case  by  binary  representation.  This  can 

be  done  with  a  slightly  modified  form  of  the  backtracking  procedure 

used  here.  The  induced  changes  should  be  obvious,  such  as  a  change 

in  the  coefficient  of  w,  in  <LP_)  from  1  to  the  given  upper  bound  on 

J  a 

x^ .  An  alternative  would  be  to  keep  the  binary  representation  of  upper 
bounded  variables  but  to  take  advantage  of  the  resulting  special  struc¬ 
ture;  in  an  expansion  requiring  5  binary  variables,  for  example,  only 
one  of  the  corresponding  coluens  of  the  A  matrix  need  be  stored  explic¬ 
itly  since  the  other  4  can  be  generated  as  needed  from  the  stored 


column. 
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